Predicting Inattentional Blindness with Pupillary Response in a Simulated Flight Task

Inattentional blindness (IB) is the failure of observers to notice the presence of a clearly viewable but unexpected visual event when attentional resources are diverted elsewhere. Knowing when an operator is unable to respond or detect an unexpected event may help improve safety during task performance. Unfortunately, it is difficult to predict when such failures might occur. The current study was a secondary data analysis of data collected in the Human and Autonomous Vehicle Systems Laboratory at NASA Langley Research Center. Specifically, 60 subjects (29 male, with normal or corrected-to-normal vision, mean age of 34.5 years (SD = 13.3) were randomly assigned to one of three automation conditions (full automation, partial automation, and full manual) and took part in a simulated flight landing task. The dependent variable was the detection/non-detection of an IB occurrence (a truck on the landing runway). Scores on the NASA-TLX workload rating scale varied significantly by automation condition. The full automation condition reported the lowest subjective task load followed by partial automation and then manual condition. IB detection varied significantly across automation condition. The moderate workload condition of partial automation exhibited the lowest likelihood of IB occurrence. The low workload full automation condition did not differ significantly from the manual condition. Subjects who reported higher task demand had increased pupil dilation and subjects with larger pupil dilation were more likely to detect the runway incursion. These results show eye tracking may be used to identify periods of reduced unexpected visual stimulus detection for possible real-time IB mitigation

Exploring Cognitive States: Methods for Detecting Physiological Temporal Fingerprints

Cognitive state detection and its relationship to observable physiologically telemetry has been utilized for many human-machine and human-cybernetic applications. This paper aims at understanding and addressing if there are unique psychophysiological patterns over time, a physiological temporal fingerprint, that is associated with specific cognitive states. This preliminary work involves commercial airline pilots completing experimental benchmark task inductions of three cognitive states: 1) Channelized Attention (CA); 2) High Workload (HW); and 3) Low Workload (LW). We approach this objective by modeling these "fingerprints" through the use of Hidden Markov Models and Entropy analysis to evaluate if the transitions over time are complex or rhythmic/predictable by nature. Our results indicate that cognitive states do have unique complexity of physiological sequences that are statistically different from other cognitive states. More specifically, CA has a significantly higher temporal psychophysiological complexity than HW and LW in EEG and ECG telemetry signals. With regards to respiration telemetry, CA has a lower temporal psychophysiological complexity than HW and LW. Through our preliminary work, addressing this unique underpinning can inform whether these underlying dynamics can be utilized to understand how humans transition between cognitive states and for improved detection of cognitive states

Repeated Induction of Inattentional Blindness in a Simulated Aviation Environment

The study reported herein is a subset of a larger investigation on the role of automation in the context of the flight deck and used a fixed-based, human-in-the-loop simulator. This paper explored the relationship between automation and inattentional blindness (IB) occurrences in a repeated induction paradigm using two types of runway incursions. The critical stimuli for both runway incursions were directly relevant to primary task performance. Sixty non-pilot participants performed the final five minutes of a landing scenario twice in one of three automation conditions: full automation (FA), partial automation (PA), and no automation (NA). The first induction resulted in a 70 percent (42 of 60) detection failure rate with those in the PA condition significantly more likely to detect the incursion compared to the FA condition or the NA condition. The second induction yielded a 50 percent detection failure rate. Although detection improved (detection failure rates declined) in all conditions, those in the FA condition demonstrated the greatest improvement with doubled detection rates. The detection behavior in the first trial did not preclude a failed detection in the second induction. Group membership (IB vs. Detection) in the FA condition showed a greater improvement than those in the NA condition and rated the Mental Demand and Effort subscales of the NASA-TLX (NASA Task Load Index) significantly higher for Time 2 compared Time 1. Participants in the FA condition used the experience of IB exposure to improve task performance whereas those in the NA condition did not, indicating the availability and reallocation of attentional resources in the FA condition. These findings support the role of engagement in operational attention detriment and the consideration of attentional failure causation to determine appropriate mitigation strategies

Quantifying Pilot Contribution to Flight Safety during Hydraulic Systems Failure

Accident statistics cite the flight crew as a causal factor in over 60% of large transport aircraft fatal accidents. Yet, a well-trained and well-qualified pilot is acknowledged as the critical center point of aircraft systems safety and an integral safety component of the entire commercial aviation system. The latter statement, while generally accepted, cannot be verified because little or no quantitative data exists on how and how many accidents/incidents are averted by crew actions. A joint NASA/FAA high-fidelity motion-base human-in-the-loop test was conducted using a Level D certified Boeing 737-800 simulator to evaluate the pilot's contribution to safety-of-flight during routine air carrier flight operations and in response to aircraft system failures. To quantify the human's contribution, crew complement (two-crew, reduced crew, single pilot) was used as the independent variable in a between-subjects design. This paper details the crew's actions, including decision-making, and responses while dealing with a hydraulic systems leak - one of 6 total non-normal events that were simulated in this experiment

Impact of Advanced Synoptics and Simplified Checklists During Aircraft Systems Failures

AbstractNatural human capacities are becoming increasingly mismatched to the enormous data volumes, processing capabilities, and decision speeds demanded in todays aviation environment. Increasingly Autonomous Systems (IAS) are uniquely suited to solve this problem. NASA is conducting research and development of IAS - hardware and software systems, utilizing machine learning algorithms, seamlessly integrated with humans whereby task performance of the combined system is significantly greater than the individual components. IAS offer the potential for significantly improved levels of performance and safety that are superior to either human or automation alone. A human-in-the-loop test was conducted in NASA Langleys Integration Flight Deck B-737-800 simulator to evaluate advanced synoptic pages with simplified interactive electronic checklists as an IAS for routine air carrier flight operations and in response to aircraft system failures. Twelve U.S. airline crews flew various normal and non-normal procedures and their actions and performance were recorded in response to failures. These data are fundamental to and critical for the design and development of future increasingly autonomous systems that can better support the human in the cockpit. Synoptic pages and electronic checklists significantly improved pilot responses to non-normal scenarios, but implementation of these aids and other intelligent assistants have barriers to implementation (e.g., certification cost) that must overcome

Quantifying Pilot Contribution to Flight Safety during Drive Shaft Failure

Accident statistics cite the flight crew as a causal factor in over 60% of large transport aircraft fatal accidents. Yet, a well-trained and well-qualified pilot is acknowledged as the critical center point of aircraft systems safety and an integral safety component of the entire commercial aviation system. The latter statement, while generally accepted, cannot be verified because little or no quantitative data exists on how and how many accidents/incidents are averted by crew actions. A joint NASA/FAA high-fidelity motion-base simulation experiment specifically addressed this void by collecting data to quantify the human (pilot) contribution to safety-of-flight and the methods they use in today's National Airspace System. A human-in-the-loop test was conducted using the FAA's Oklahoma City Flight Simulation Branch Level D-certified B-737-800 simulator to evaluate the pilot's contribution to safety-of-flight during routine air carrier flight operations and in response to aircraft system failures. These data are fundamental to and critical for the design and development of future increasingly autonomous systems that can better support the human in the cockpit. Eighteen U.S. airline crews flew various normal and non-normal procedures over a two-day period and their actions were recorded in response to failures. To quantify the human's contribution to safety of flight, crew complement was used as the experiment independent variable in a between-subjects design. Pilot actions and performance during single pilot and reduced crew operations were measured for comparison against the normal two-crew complement during normal and non-normal situations. This paper details the crew's actions, including decision-making, and responses while dealing with a drive shaft failure - one of 6 non-normal events that were simulated in this experiment

Mild Normobaric Hypoxia Exposure for Human-Autonomy System Testing

An experiment investigated the impact of normobaric hypoxia induction on aircraft pilot performance to specifically evaluate the use of hypoxia as a method to induce mild cognitive impairment to explore human-autonomous systems integration opportunities. Results of this exploratory study show that the effect of 15,000 feet simulated altitude did not induce cognitive deficits as indicated by performance on written, computer-based, or simulated flight tasks. However, the subjective data demonstrated increased effort by the human test subject pilots to maintain equivalent performance in a flight simulation task. This study represents current research intended to add to the current knowledge of performance decrement and pilot workload assessment to improve automation support and increase aviation safety

An Assessment of Reduced Crew and Single Pilot Operations in Commercial Transport Aircraft Operations

Future reduced crew operations or even single pilot operations for commercial airline and on-demand mobility applications are an active area of research. These changes would reduce the human element and thus, threaten the precept that "a well-trained and well-qualified pilot is the critical center point of aircraft systems safety and an integral safety component of the entire commercial aviation system." NASA recently completed a pilot-in-the-loop high fidelity motion simulation study in partnership with the Federal Aviation Administration (FAA) attempting to quantify the pilot's contribution to flight safety during normal flight and in response to aircraft system failures. Crew complement was used as the experiment independent variable in a between-subjects design. These data show significant increases in workload for single pilot operations, compared to two-crew, with subjective assessments of safety and performance being significantly degraded as well. Nonetheless, in all cases, the pilots were able to overcome the failure mode effects in all crew configurations. These data reflect current-day flight deck equipage and help identify the technologies that may improve two-crew operations and/or possibly enable future reduced crew and/or single pilot operations

Quantifying Pilot Contribution to Flight Safety During Dual Generator Failure

Accident statistics cite flight crew error in over 60% of accidents involving transport category aircraft. Yet, a well-trained and well-qualified pilot is acknowledged as the critical center point of aircraft systems safety and an integral safety component of the entire commercial aviation system. No data currently exists that quantifies the contribution of the flight crew in this role. Neither does data exist for how often the flight crew handles non-normal procedures or system failures on a daily basis in the National Airspace System. A pilot-in-the-loop high fidelity motion simulation study was conducted by the NASA Langley Research Center in partnership with the Federal Aviation Administration (FAA) to evaluate the pilot's contribution to flight safety during normal flight and in response to aircraft system failures. Eighteen crews flew various normal and non-normal procedures over a two-day period and their actions were recorded in response to failures. To quantify the human's contribution, crew complement was used as the experiment independent variable in a between-subjects design. Pilot actions and performance when one of the flight crew was unavailable were also recorded for comparison against the nominal two-crew operations. This paper details diversion decisions, perceived safety of flight, workload, time to complete pertinent checklists, and approach and landing results while dealing with a complete loss of electrical generators. Loss of electrical power requires pilots to complete the flight without automation support of autopilots, flight directors, or auto throttles. For reduced crew complements, the additional workload and perceived safety of flight was considered unacceptable

Colorectal Cancer Stem Cells Are Enriched in Xenogeneic Tumors Following Chemotherapy

Patients generally die of cancer after the failure of current therapies to eliminate residual disease. A subpopulation of tumor cells, termed cancer stem cells (CSC), appears uniquely able to fuel the growth of phenotypically and histologically diverse tumors. It has been proposed, therefore, that failure to effectively treat cancer may in part be due to preferential resistance of these CSC to chemotherapeutic agents. The subpopulation of human colorectal tumor cells with an ESA(+)CD44(+) phenotype are uniquely responsible for tumorigenesis and have the capacity to generate heterogeneous tumors in a xenograft setting (i.e. CoCSC). We hypothesized that if non-tumorigenic cells are more susceptible to chemotherapeutic agents, then residual tumors might be expected to contain a higher frequency of CoCSC.Xenogeneic tumors initiated with CoCSC were allowed to reach approximately 400 mm(3), at which point mice were randomized and chemotherapeutic regimens involving cyclophosphamide or Irinotecan were initiated. Data from individual tumor phenotypic analysis and serial transplants performed in limiting dilution show that residual tumors are enriched for cells with the CoCSC phenotype and have increased tumorigenic cell frequency. Moreover, the inherent ability of residual CoCSC to generate tumors appears preserved. Aldehyde dehydrogenase 1 gene expression and enzymatic activity are elevated in CoCSC and using an in vitro culture system that maintains CoCSC as demonstrated by serial transplants and lentiviral marking of single cell-derived clones, we further show that ALDH1 enzymatic activity is a major mediator of resistance to cyclophosphamide: a classical chemotherapeutic agent.CoCSC are enriched in colon tumors following chemotherapy and remain capable of rapidly regenerating tumors from which they originated. By focusing on the biology of CoCSC, major resistance mechanisms to specific chemotherapeutic agents can be attributed to specific genes, thereby suggesting avenues for improving cancer therapy